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METHOD AND APPARATUS FOR MOBILE PHONE 
USING SEMICONDUCTOR DEVICE CAPABLE OF 
INTER-PROCESSING VOICE SIGNAL AND AUDIO SIGNAL 

5 BACKGROUND 

FIELD 

This patent specification generally relates to a 
method and apparatus for a mobile phone, and, in particular, 
to a method and apparatus for a mobile phone capable of 
10 reproducing and/or -recording audio using a semiconductor 

device which performs inter-processing of digital audio and 
voice signals to increase the quality thereof. 

DISCUSSION OF THE BACKGROUND 

15 The increase in packing density of large-scale 

integration (LSI) in recent years has promoted tighter 
packing of functions used in a mobile phone. Multi- 
functional mobile phones thus are now becoming common and 
are capable of working as a telephone and music player, or 

20 as a telephone, a music player, and a movie and music 

recorder at the same time, for example. Such a mobile phone 
uses an installed LSI component or a discrete component, as 
necessary, to mix a voice signal with an audio signal. The 
voice signal is input from an input device, such as a 

25 microphone, or received from another telephone and 

demodulated, while the audio signal is reproduced in the 
mobile phone. A signal mixed in such a manner is 
transmitted to an output device such as a* speaker or a 
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headphone . 

FIG. 1 is a block diagram showing an exemplary unit 
for sound processing used in a conventional mobile phone, as 
described in Japanese Laid-Open Patent Application 
5 Publication No. 2000-299718, for example. 

In FIG. 1, a received and demodulated digital voice 
signal SDVa is converted into an analog signal with a voice 
digital-to-analog (DA) converter 101, processed with a 
volume adjustment and so forth in an analog processing 

10 circuit 104, and output from a voice output device, such as 
a first speaker SP1 . A reproduced audio signal S DA is 
converted into an analog signal with an audio DA converter 
103. An analog processing circuit 106 performs on the 
converted audio signal SDA an addition or subtraction with 

15 the analog voice signal, or a volume adjusting. The 

processed audio signal SDA processed is then output from an 
audio output device such as a second speaker SP2 or a 
headphone HP. 

An analog voice signal from a voice input device, such 
20 as a microphone MIC, on the other hand, is processed with an 
analog processing circuit 105 which performs a volume 
adjustment, an , addition/subtraction with the analog audio 
signal, or the like. The processed analog voice signal is 
further converted into a digital voice signal SDVb with an 
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audio analog-to-digital (AD) converter, and transmitted to a 
processing block for a modulation and transmission. It is 
to be noted that a signal path of a mixed signal of voice 
and audio shown in FIG. 1 is one possible example. There 
5 may be various signal paths for the mixed signal, depending 
on a type of the mobile phones. 

A conventional technique, however, experiences 
problems such as deterioration in quality of an analog 
signal or generation of auditory noise due to high-frequency 

10 noise in a mobile phone, caused by analog signal processing, 
that is, an addition/subtraction or a volume adjustment 
using an operational amplifier. 

It is also desirable to provide a mobile phone using a 
semiconductor device which is capable of mounting a digital 

15 class-D amplifier in place of a class-AB amplifier, thereby 
increasing electric power efficiency. 

SUMMARY 

This patent specification describes a novel 
2 0 semiconductor device which can be used in a mobile phone 
that processes digital signals. In one example, a novel 
semiconductor device includes a first converter, a second 
converter, a first digital processor, and a second digital 
processor. The first converter converts a first digital 
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audio signal sampled with a predetermined audio sampling 
frequency for digital audio into a second digital audio 
signal sampled with a predetermined voice sampling frequency 
for voice signals. The second converter converts a first 
5 digital voice signal sampled with the predetermined voice 
sampling frequency into a second digital voice signal 
sampled with the predetermined audio sampling frequency. 
The first digital processor performs a predetermined digital 
computation on the second digital audio signal sampled with 

10 the predetermined voice sampling frequency and a digital 

voice signal. The second digital processor is configured to 
perform the predetermined digital computation on the first 
digital voice signal sampled with the predetermined audio 
sampling frequency and the first digital audio signal 

15 sampled with the predetermined audio sampling frequency. 
The predetermined digital computation may be 
configured to include an addition, a subtraction, a rate 
setting of the addition, and a rate setting of the 
subtraction . 

20 The first digital processor may be configured to 

perform a volume setting on a digital signal processed with 
the predetermined digital computation. 

The first digital processor may be configured to 
perform a signal band restriction on a digital signal 
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processed with the predetermined digital computation. 

The signal band restriction may be configured to be 
pre-programmable . 

The second digital processor may be configured to 
5 perform a volume setting on a digital signal processed with 
the predetermined digital computation. 

The second digital processor may be configured to 
perform a signal band restriction on a digital signal 
processed with the predetermined digital computation. 
10 The signal band restriction may be configured to be 

pre-programmable . 

In another example, a mobile phone using a 
semiconductor device includes an input device, a voice AD 
converter, a voice DA converter, an output device, an audio 
15 DA converter, and an audio output device. The input device 
converts a voice into an analog voice signal and outputs the 
analog voice signal. The voice AD converts the analog voice 
signal output from the input device into a digital signal 
and outputs the digital signal as a first digital voice 
2 0 signal . 

The voice DA converter converts a second digital voice 
signal sampled with a predetermined voice sampling frequency 
for a voice signal into an analog voice signal. The voice 
output device generates a voice sound in accordance with the 
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analog voice signal output from the voice digital-to-analog 
converter. The audio DA converter converts a digital audio 
signal sampled with a predetermined audio sampling frequency 
for an audio signal into an analog audio signal. The audio 
5 output device generates an audio sound in accordance with 
the analog audio signal output from the audio DA converter. 
The semiconductor device processes and outputs the first 
digital voice signal., the second digital voice signal 
sampled with the predetermined voice sampling frequency, and 

10 the digital audio signal sampled with the predetermined 

audio sampling frequency. The semiconductor device includes 
a first converter, a second converter, a first digital 
processor, and a second digital processor. 

In another example, a mobile phone using a 

15 semiconductor device includes an input device, a voice AD 

converter, a digital voice amplifier, a voice output device, 
an audio digital amplifier, and an audio output device. 

The input device converts a voice into an analog voice 
signal. The voice AD converter converts the analog voice 

20 signal output from the input device into a first digital 
voice signal. The digital voice amplifier amplifies and 
output a second digital voice signal sampled with a 
predetermined voice sampling frequency for a voice signal. 
The voice output device generates a voice sound in 
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accordance with the second digital voice signal output from 
the digital voice amplifier. The digital audio amplifier 
amplifies and outputs a digital audio signal sampled with a 
predetermined audio sampling frequency for an audio signal. 
5 The audio output device generates an audio sound in 

accordance with the digital audio signal output from the 
digital audio amplifier. 

The semiconductor device processes and outputs the 
first digital voice signal, the second digital voice signal 
10 sampled with the predetermined voice sampling frequency, and 
the digital audio signal sampled with the predetermined 
audio sampling frequency. 

This patent specification further describes another 
15 novel method of providing a semiconductor device. In one 
example, the novel method includes the steps of first 
converting, second converting, first digital processing, and 
second digital processing. The first converting step 
converts a first digital audio signal sampled with a 
20 predetermined audio sampling frequency for digital audio 
into a second digital audio signal sampled with a 
predetermined voice sampling frequency for voice signals. 
The second converting step converts a first digital voice 
signal sampled with- the predetermined voice sampling 
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frequency into a second digital voice signal sampled with 
the predetermined audio sampling frequency. The first 
digital processing processes the second digital audio signal 
sampled with the predetermined voice sampling frequency and 
a third digital voice signal with a predetermined digital 
computation. The second digital processing processes the 
second digital voice signal sampled with the predetermined 
audio sampling frequency and the first digital audio signal 
sampled with the predetermined audio sampling frequency with 
the predetermined digital computation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete appreciation of the disclosure and 
many of the attendant advantages thereof will be readily 
obtained as the same becomes better understood by reference 
to the following detailed description when considered in 
connection with the accompanying drawings, wherein: 

FIG. 1 is a block diagram showing a unit of sound 
processing used in a conventional mobile phone; 

FIG. 2 is a block diagram showing a semiconductor 
device according to an exemplary embodiment of the present 
specification; 

FIG. 3 is a table listing combinations of sampling 
frequencies used in converting sampling frequencies; and 
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FIG. 4 is a block diagram showing a semiconductor 
device according to another exemplary embodiment of the 
present specification . 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
In describing preferred embodiments illustrated in the 
drawings, specific terminology is employed for the sake of 
clarity. However, the disclosure of this patent 
specification is not intended to be limited to the specific 
terminology so selected and it is to be understood that each 
specific element includes all technical equivalents that 
operate in a similar manner. Referring now to the drawings, 
wherein like reference numerals designate identical or 
corresponding parts throughout the several views, 
particularly to FIG. 2, an audio device 1 according to an 
exemplary embodiment of the present specification is 
described. FIG. 2 shows an exemplary configuration of a 
semiconductor device used in the audio device 1 installed in 
a mobile phone, for example. Portions performing voice 
sending/receiving and audio reproducing are omitted in the 
figure . 

In Fig. 2, the audio device 1 is provided with a first 
sampling frequency converting circuit 11, a second sampling 
frequency converting circuit 12,. a first over-sampling 
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circuit 13, a second over-sampling circuit 14, and a down- 
sampling circuit 15. The audio device 1 is also provided 
with a first digital processing circuit 16, a second digital 
processing circuit 17, a third digital processing circuit 18, 
5 a voice DA converter 19, a voice AD converter 20, an audio 
DA converter 21, a first speaker SP1, a second speaker SP2, 
a microphone MIC, and a headphone HP. The first speaker SP1 
outputs a voice sound while the second speaker SP2 outputs 
an audio sound. The microphone MIC works to input a voice 

10 sound. The first speaker SP1 and the microphone MIC form a 
receiver of the mobile phone. 

FIG. 2 also includes a first digital voice signal SDV1, 
a second digital voice signal SDV2, a digital audio signal 
SDA, a first analog voice signal SAV1, a second analog voice 

15 signal SAV2 , an analog audio signal SAA, a first sampling 
frequency Fs 1 , and a second sampling frequency Fs2. A 
digital voice signal SDV will be used for referring to 
either of the first digital voice signal SDV1 and the second 
digital voice signal SDV2. 

20 A configuration is possible that integrates the 

following components onto one integrated circuit (IC) . The 
first sampling frequency converting circuit 11, the second 
sampling frequency converting circuit 12, the first over- 
sampling processing circuit 13, the second over-sampling 
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processing circuit 14, the first digital processing circuit 
16, the second digital processing circuit 17, the third 
digital processing circuit 18, the voice DA converter 19, 
the voice AD converter 20, and the audio DA converter 21. 
5 The second sampling frequency Fs2 applied to the 

digital voice signal SDV normally adopts a frequency of 8kHz 
or 16kHz. As for the first sampling frequency Fsl for the 
digital music signal SDA, a frequency of 32kHz, 44.1kHz, or 
48kHz is normally adopted. Since an analog signal is a 

10 sequential signal, it is capable of being directly processed 
in an addition or subtraction. An idea of sampling is thus 
inapplicable to the analog signal. In contrast, as a 
digital signal is a sampled discrete time signal, it is 
unable to be added or subtracted with other digital signals 

15 sampled with different sampling frequencies. 

To solve the above problem, the first sampling 
frequency converting circuit 11 converts the digital audio 
signal SDA sampled with the first sampling frequency Fsl 
into a signal sampled with the second sampling frequency Fs2 

20 used for the digital voice signal SDV. The second sampling 
frequency converting circuit 12 converts, in reverse, the 
digital voice signal SDV1 sampled with the second sampling 
frequency Fs2 into a signal sampled with the first sampling 
frequency Fsl used for the digital audio signal SDA. 
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The above process makes the sampling frequencies in 
digital signals identical, thereby enabling the addition and 
subtraction of the digital voice signal SDV and the digital 
audio signal SDA to and from each other. 
5 In this case, the first and second sampling 

frequencies Fsl and Fs2 make twelve combinations of possible 
sampling frequency conversions, as shown in FIG. 3. The 
voice digital signal SDV and the audio digital signal SDA 
are converted with corresponding sampling frequencies 

10 selected each time according to conditions. In one 

exemplary case, an 8kHz to 44.1kHz conversion is applied to 
the digital voice signal SDV, while a 44.1kHz to 8kHz 
conversion is applied to the digital audio signal SDA. A 
technique of a circuit processing a sampling frequency 

15 conversion is publicly known, as described in "Interpolation 
and' Decimation of Digital Signal-A tutorial Review" Lawrence 
R.Rabiner, Proceeding of The IEEE, vol.69, No. 3 March 1981, 
for example. 

As the DA and AD converters in the audio device 1, a 
2 0 delta-sigma typed DA converter and AD converter may be 
adopted. The delta-sigma typed DA converter and AD 
converter respectively require an over-sampling and down- 
sampling operations in digital processing. The first over- . 
sampling circuit 13 and the second over-sampling circuit 14 
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perform the over-sampling operation, and the down-sampling 
circuit 15 performs down-sampling operation. These sampling 
operations are required in the delta-sigma typed converters, 
as well as serving as a part of the over-sampling and down- 
5 sampling operations required in the sampling frequency 
conversion. For example, the first sampling frequency 
converting circuit 11 converts a sampling frequency from 4 x 
Fsl into 4 x Fs2, while the second sampling frequency 
converting circuit 12 converts another sampling frequency of 

10 4 x Fs2 into 4 x Fsl. The sampling frequency conversion in 

this example is a process for converting a multiplication of 
an original sampling frequency into a multiplication of a 
target sampling frequency. 

In FIG. 2, the received and demodulated digital voice 

15 signal SDV1 is sampled with the second sampling frequency 
Fs2-. The digital voice signal SDV1 is over-sampled in the 
first over-sampling circuit 13 with the frequency of 4 x Fs2, 
i.e., four-times multiplication of the second sampling 
frequency Fs2 . The sampled digital voice signal SDV1 is 

20 further transmitted separately to the first digital 

processing circuit 16 and the second sampling frequency 
converting circuit 12. The first digital processing circuit 
16 processes the digital voice signal SDV1 with a volume 
adjustment, a signal band limitation, or the like. The 
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processed digital voice signal SDV1 is converted into the 
analog voice signal SAV1 with the voice DA converter 19, and 
output. from the first speaker SP1 . The second sampling 
frequency converting circuit 12 converts the digital voice 
5 signal SDV1 into a signal sampled with the frequency of 4 x 
Fsl, where Fsl is the first sampling frequency used for the 
digital audio signal SDA. 

The reproduced and sampled digital audio signal SDA 
with the first sampling frequency Fsl is over-sampled in the 

10 second over-sampling circuit 14 with the frequency of 4 x 

Fsl, i.e., four-times multiplication of the first sampling ' 
frequency Fsl. The sampled digital audio signal SDA is 
further transmitted separately to the third digital 
processing circuit 18 and the first sampling frequency 

15 converting circuit 11. The third digital processing circuit 
18 processes the digital audio signal SDA by adding or 
subtracting the digital voice signal SDV1 converted with the 
. sampling frequency above, setting a ratio of the adding or 
subtracting, adjusting a volume, and adjusting a tone with a 

20 signal band limiting process pre-programmed with a 

predetermined setting. The processed digital audio signal 
SDA is further converted with the audio DA converter 21 into 
the analog audio signal SAA and output from the second 
speaker SP2 or the headphone HP. The first sampling 
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frequency converting circuit 11 converts the digital audio 
signal SDA into a signal sampled with the frequency of 4 x 
Fs2, where Fs2 is the second sampling frequency used for the 
digital voice signal SDV1. 
5 The analog voice signal SAV2 from a voice input device 

like the microphone MIC is converted with the voice AD 
converter 20 into the digital voice signal SDV2 . The second 
digital processing circuit 17 processes the digital voice 
signal SDV2 , including adding or subtracting the digital 

10 audio signal SDA, setting a ratio of the adding or 

subtracting, and adjusting a volume. The down-sampling 
circuit 15 samples the digital voice signal SDV2 with a 
frequency of a quarter of 4 x Fs2, i.e., the sampling 
frequency Fs2, and sends it to a circuit block (not shown) 

15 which processes modulation for a transmission. 

Referring to FIG. 4, another exemplary embodiment of 
the present specification will now be described. The audio 
device 1 shown in FIG. 4 includes a digital amplifier 29 and 
an audio digital amplifier 31, as substitutions for the 

20 voice DA converter 19 and the audio DA converter 21 shown in 
FIG. 2, respectively. Other components of the audio device 
1 in FIG. 4 are in common. with components shown in FIG. 2. A 
configuration is possible that integrates the following 
components onto one IC: the first sampling frequency 
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converting circuit 11, the second sampling frequency 
converting circuit 12, the first over-sampling processing 
circuit 13, the second over-sampling processing circuit 14, 
the first digital processing circuit 16, the second digital 
5 processing circuit 17, the third digital processing circuit 
18, the voice digital amplifier 29, the voice AD converter 
20, and the audio digital amplifier 31. 

Since signal processes performed in the audio device 1 
are digitalized, digital amplifiers may replace, without any 

10 difficulty, the DA converters used in the embodiment shown 

in FIG. 2. Although the configuration shown in FIG. 4 still 
leaves a signal to remain analog in a part from the 
microphone MIC to the following voice AD converter C2, it 
allows to digitalize most processes, such as driving the 

15 voice and audio output devices, for example. Consequently, 
it is possible to increase efficiency of electric power due 
to the digital amplifiers. 

As described in the above embodiments, the audio 
device 1 enables the addition or subtraction of the digital 

20 voice and digital audio signals by converting them with 
appropriate sampling frequencies. This allows 

digitalization of signal processing which used to be analog, 
thereby reducing deterioration of analog qualities caused by 
a variation of the process, and generation of noise caused 



16 



Dkt. 2271/71539 
AP03-793 

by external noise. Furthermore, this digitalization enables 
downsizing of the circuit and easier transfer of the 
processes. It is also possible to increase efficiency of 
electric power of the circuit equipped with digital 
5 amplifiers . 

A signal path described in the above embodiments and 
used in the addition or subtraction of the voice or audio 
signal is one example. In practical mobile phones, there 
"exist various kinds of signal paths for the addition or 

10 subtraction according to a type of an application. It may 
be possible, for example, to provide a signal path for the 
addition or subtraction as follows. Firstly, the digital 
voice signal SDV is added or subtracted with the digital 
audio signal S DA and output to a voice output system. 

15 Secondly, the digital audio signal SDA is added or 

subtracted with the digital voice signal SDV2 from the voice 
AD converter 20, and output to an audio output system. In 
the above examples, the sampling frequency converting 
circuits of the present specification enables the adding or 

20 subtracting process to be digitalized, thereby also 

digitalizing signal processes in an input and output systems. 
Furthermore, in a case of including an additional audio AD 
converter for a music recording and so forth in which a 
signal path of the addition or subtraction may become more 
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complex, for example, adopting the sampling frequency 
converting circuits of the present specification also 
enables signal processes to be digitalized in the input and 
output systems . 

5 

This specification may be conveniently implemented 
using a conventional general purpose digital computer 
programmed according to the teachings of the present 
specification, as will be apparent to those skilled in the 

10 computer art. Appropriate software coding can readily be 
prepared by skilled programmers based on the teachings of 
the present disclosure, as will be apparent to those skilled 
in the software art. The present invention may also be 
implemented by the preparation of application specific 

15 integrated circuits or by interconnecting an appropriate 
network of conventional component circuits, as will be 
readily apparent to those skilled in the art. 

Numerous additional modifications and variations are 
20 possible in light of the above teachings. It is therefore 
to be understood that within the scope of the appended 
claims, the disclosure of this patent specification may be 
practiced otherwise than as specifically described herein. 

18 
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This patent specification is based on Japanese patent 
application, No . JPAP2003-095485 filed on March 31, 2003 in 
the Japanese Patent Office, the entire contents of which are 
incorporated by reference herein. 
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